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Method and qyparatus for realizing pefsonaUzed infimnation fiom multiple infonnation 
sources 



BACKGROUND OF THE INVENTION 
Field of Ifaelnventian 

Hie piesent invention relates to browsing and/or searching various uiformation 
sources, and more particulariy to searching and/or presrating information fix>m multiple 
S information sources in a personalized and organized manner. 

Description of Related Art 

Web browsers and electronic progiam guides pemnt a user to browse various 
information sources siKsh as Web sites, televiaon program listings, and music collections. 

10 Typically, such searches are Umited to one type of collection of information. For example, a 
user who is interested in infonnation on a particular television program may lm>wse the Web 
using a search engine, which will presmt the user with a listing of Web sites related to the 
particular television program. However, the results typically would not incliuie the time when 
Ae particular television program is being shown in the user's viewing area. Television 

1 5 schedule infonnation ^ically would have to be accessed sqparately using, for example, an 
electronic program guide. 

Tools used for searching Web sites have been uiq>roved by including a 
csqiability of generating recommendations based on a profile of die user's interests, as have 
tools for viewiog television and tools for listening to music. For example, a pcnrson may use a 

20 Web browser to access a search engine to obtain list of recommended Web sites based on the 
person's historical browsing activities, a pexsoa wishing to watch television may receive a list 
of recommoided television programs to view based on the person's historical television 
viewing activities, and a person wishing to listen to music may receive a list of recommended 
music to listen to based on die prason's historical listening activities 

25 Various prqiosals have been made to improve the usefolness of searching by 

l»oviding an inu^rated iqjproach to specifying and seardbdng multiple information resources. 
While some of diese prqiosals do generally advance die state of the art, forttier 
improvCTients are needed that use existing standards and a pl^ora of new componmt 
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technologies to provide a search tool that gives the user greater access to a variety of different 
content types from a variety of different sources in a personalized, easy and intuitive way. 

SUMMARY OF THE INVENTION 

5 One embodiment of the present invention is a method of realizing personalized 

information for a user from multiple information sources, comprising establishing a user 
profile for the user bases on various interests of the user; establishing a virtual unified space; 
populating the virtual unified space with a plurality of different virtual media collections in 
accordance with the user profile; and browsing the unified space under user control. 

1 0 Another embodiment of the present invention is a receiver apparatus for 

obtaining content from multiple information sources for viewing by a viewer. The receiver 
comprises an input/output ("I/O") controller including an Internet connection input, a video 
output, and a selector input; an adaptive user profile database; a filter coupled to the adaptive 
user profile database, the filter being coupled to the I/O controller for filtering information 

1 5 from the Intemet connection input in accordance with the adaptive user profile database; 
means for displaying a virtual unified space through the video output; means for populating 
the virtual unified space with virtual multiple media collections using the filtered information 
from the implicit filter; and means for browsing the unified space in accordance with the 
selector input. 

20 Another embodiment of the present invention is a computer program product. 

The computer program product comprises a computer readable medium having program 
logic recorded thereon for enabling a computer-enabled apparatus to display personalized 
information for a user from multiple information sources, comprising means for establishing 
• a user profile for the user bases on various interests of the user; means for establishing a 
25 virtual unified space; means for populating the virtual unified space with a plurality of 
different virtual media collections in accordance with the user profile; and means for 
browsing the unified space under usct control. 



BRIEF DESCRIPTION OF THE DRAWINGS 
30 Figure 1 is a pictorial representations of a virtual digital library, in accordance 

with the present invention. 

Figure 2 is a pictorial representations of various shelves in the virtual digital 
library of Figure 1 as seen by a user while browsing, in accordance with the present 
invention. 
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Figure 3 is a pictorial represmtations of one of the shelves of Figure 2 as seen 
by a user while browsing, in accordance with the present invention. 

Figure 4 is a block schematic diagram of a meta-browser system in accordance 
with the present invention. 
5 Figures 5 A, 5B and 5C are segments of a flowchart of an illustrative operating 

session of the meta-browser of Figure 4, in accordance with the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

A meta-browser presents personalized collections of information from 

1 0 multiple sources of different media types in a single browsing space. The presentation of 
collections of information from multiple sources of different media types in a single 
browsing space enhances a user's browsing experience by providing easy access to relevant 
information and the ability to search across multiple media types with a single search query. 
A user's browsing experience is further enhanced by personalized recommendations, which 

15 are generated based on a profile of the user's interests captured across multiple media 
sources. Collaborative filtering, which uses multiple user profiles to compute co-relations 
between the user's profile and others, is also used to make recommendations. As a result, the 
user has greater access to a variety of different content types in a personalized, easy and 
intuitive way. 

20 The metaphor underlying the meta-browser is shown in Figure 1 . The 

metaphor is a virtual library that has multiple floors. For example, floor 10 contains 
community events, which includes, for example, two stack or shelve areas 11 and 12, each 
dedicated to a certain type of community event such as public hearings, public talks and 
debates, public celebrations and parades, non-profit organization meetings, volunteer 

25 community activities, and so forth. Floor 20 contains books, which includes, for example, 
three stack or shelve areas 21, 22 and 23, each dedicated to a certain category of books such 
as, for example, mystery, science fiction, classics, reference works, biographies, and so forth. 
Floor 30 contains movies, which includes, for example, five stack or shelve areas 31, 32, 33, 
34 and 35, each dedicated to a certain genre of movie such as, for example, comedy, science 

30 fiction, action, drama. Westerns, and so forth. Floor 40 contains music, which includes, for 
example, five stack or shelve areas 41, 42, 43, 44 and 45, each dedicated to a certain genre of 
music such as, for example, jazz, rock, the Beatles, movie soundtracks, country, and so forth. 
Floor 50 contains television programs, which includes, for example, five stack or shelve areas 
51, 52, 53, 54 and 55, each dedicated to a certain type of television progranmiing such as, for 
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example^ sitcoms, TV magazines, news, sports, Westerns, and so fijittL The type of floors in 
the virtual library, tiie types of stacks populating each floor, and the specific media items on 
each of the stacks preferably are selected based on the us^'s profile, altfaou^ they may also 
be based on all of the information that is available to the meta-browser when flie available 
5 information is a relatively small and manageable amount 

The unified browsing space may be the entire library, particular floors of the 
library, or one particular floor of the library, depending on what media collections die user 
wishes to browse. The user may, if desired, store the results of a search of the Int^et and 
other information sources as a stack or stacks on a floor, and browse just those results as a 
10 unified browsing space. 

Tbreiul S shown in Figure 1 rqiresents a single search across many different 
media types and sources which tibe meta-browser performs automatically for a particular user 
based on the uso-'s jnofile. For example, assume that a user frequently watches westerns 
movies and television programs but has shown no interest in books about western themes. 
15 These fiicts are included in the user's profile. When a new western movie becomes available, 
the meta-browso- provides automatic notification to the user that the new western movie is 
available, as represented by stack 35 on the movie floor 30; that the musical score for ttie 
movie and other related music (e.g. country western) is available, as rq>reseiited by stadcs 44 
and 45 on die music floor 40; that three different types of television programs (e.g. a TV 
20 magazine piece, a news report, and a TV smal) are available for viewing that are about the 
new Western movie or deal with related Western themes, as rqpresented by stacks 53, 54 and 
55 on the TV program floor 50; and that die cowboy star of the new movie will be making a 
public appearance in town at the annual rodeo, as represrated by stack 11 ontheccnnmunity 
events floor 10. Observe diat no books have been recommended. 
25 While the meta-browsa: has not recommoded any books, which is consistent 

with the user's current profile, the user is free to browse the stacks on book floor 20. One of 
the stacks, say stack 2 1 , may be the stack for westans, and the usar may browse through 
stack 21 if he wishes to find a book about die subject of the new movie. Alternatively, if die 
user can identify keywords or other search t&ans rqiresmtative of his interests, he may do an 
30 unconstrained search, i.e. a search not constrained by his profile, of all books on the entire 
book floor 20, or of just the western stack 23. If die user makes one or more book selections, 
the user^s profile is updated accordingly and the meta-browser may recommend a book in 
subsequent searches. 
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An illustrative example of a user's experience with the meta-brows^ is shown 
in Figures 2 and 3. Figure 2 shows an illustrative screen view of a "library" having three 
particxilar floors, a movie floor 1 10, a music floor 120, and a television program floor 130. In 
this example, the library having floors 1 10, 120 and 130 is the imified browsing space. The 

5 movie floor 1 10 is represented by a number of stacks containing movies that might interest 
the user, as derived firom the user's profile, illustratively a comedy stack 1 1 1, a science 
fiction stack 1 12, an action stack 1 13, a drama stack 1 14, and a Westems stack 1 15. While 
five stacks are shown, the number of stacks may be greater or less, depending on the user's 
profile. The music floor 120 is represented by a number of stacks containing music that might 

10 interest the user, as derived firom the user's profile, illustratively a jazz stack 121, a rock 
stack 122, a Beatles stack 123, a movie soundtrack stack 124, and a country stack 125. The 
television program floor 120 is represented by a number of stacks containing television 
programs that might interest the user, as derived fi*om the user's profile, illustratively a 

* situation comedy stack 131, a TV magazine stack 132, a news stack 133, a sports stack 134, 

15 and a Westems stack 135. The user browses by moving between floors, between the stacks 
on a floor, and along shelves of a stack. For example, the user moves between floors by 
selecting the up-down arrows, between the stacks on a floor by selecting the left-right arrows, 
and along a particular stack by selecting the in-out arrows. Altematively, the left-right arrows 
are used to "move" the stacks so that difiTerent stacks progressively move into the center 

20 position for so long as a left or right arrow is selected. The stack in the center position is 

browsed by selecting it with, for example, an OK button. If more information is available that 
can be shown on a screen, movement fi-om floor to floor, fi"om stack to stack, and along a 
particular stack brings previously portions into view while causing already seen portions to 
recede and disappear. 

25 Figure 3 is a view of a shelf in a particular stack which has been accessed by 

the user. The user may browse the shelf and select any of the items in any convenient 
manner, as with a mouse pointer or remote control touchscreen, or by selecting the item by 
number on a remote control touchscreen or hand held unit. 

Once the item is selected, the user is presented with more information on the 

30 item. For example, if the item is a book, selecting the book displays all of the authors, the 

entire title (an abbreviated version may have been displayed in the previous shelf view due to 
space limitations), publisher, date of publication, and number of pages. A fiuther selection of 
the same book displays an options list. An illustrative options list includes, for example, an e- 
commerce option that permits the user to price-compare and* purchase the book using 
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conventional Internet tools; an email or chat option, which permits to user to inform others 
about the book or about the user's thoughts regarding the book using conventional Internet 
tools; and a recommend option, which permits the user to learn about other infomiation 
similar to or related to the book or its subject matter across various media types. These 
5 options are presented in any convenient way, including, for example, a menu or a nested set 
of interactive menus. 

The user's profile influences not only the behavior of the individual options 
but also the particular options that are presented to the user. For example, the recommend 
option is heavily influenced by the user's profile. As a fiuther example, the options Ust is 

1 0 likely to include a "compare price" option if the user tends to research prices before 

purchasing items and is not likely to include a "compare price*' option if the user typically 
purchases each particular type of product fi-om a particular vendor. 

If the user wishes to search for an item of information rather than browse the 
stacks, the user may invoke a search engine at any level, including shelf (one or more 

15 shelves), stack (one or more selected stacks), floor (one or more selected floors), 

combinations of shelves, stacks, and floors, and the entire virtual library. An example of an 
entire library search is the search example represented by the thread 5 in Figure 1 , which if 
performed on the library in Figure 2 might illustratively yield hits fi-om stacks 1 15, 124, 125, 
132, 133 and 135. The selection of the search engine is by any convenient manner, such as by 

20 placing a mouse pointer over an icon or be pressing a particular button on a remote control 
unit. Search terms are entered by using a keyboard, touchscreen, or virtual keyboard 
displayed on the viewing screen. Depending on the user preferences, the results produced by 
the search engine may or may not be filtered in accordance with the user's profile. The 
results may be viewed in any convenient manner, as by moving along the thread 5, or 

25 creating a separate floor containing media collections resulting fi-om the search, or 
conventionally as a list. 

While the library metaphor is a particularly usefiil personalized visualization 
of heterogeneous media, other usefiil visuaUzations are possible. Other possible 
visualizations include, for example, simple nested menus and an office and file drawer 

30 metaphor. 

An illustrative system which includes various computers, input and output 
devices, local area and global networks, enabling software, and databases, is shown in Figure 
4. The meta-browser runs on the user's portion of the system, which includes receiver 320 
and user I/O devices 330. The receiver 320 and its output device 332 may be implement in 
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any of a variety of ways, including a set top box for use witii a standard or higji definition 
television monitor or receiver, a digital "smart" television, an q)plicati0n running on a 
personal computer or on a "smart" appliance having an attached monitor, or even as a 
personal smart television receive or personal data assistant ("PDA") type device having a 
5 small screen or viewing glasses, hesK^hones, and a wireless or wired IntOTiet connection* Set 
top boxes are presently available from a vari^ of vendors, including, for exanq)le, Gen^ 
Instruments, Inc. of Hordiam, Pennsylvania, and Sci«itific Atlanta, Inc. of Atlanta, Georgia, 
and even more powerfixl set top boxes arc in development and productioiL The set top box 
may be a Java console, for example. As various choices are presented to the us^ on the 
10 ou^mt device 332, the user makes a selection using selector 334. The selector 334 is any 
suitable device, sudi as, for example, a keyboard and mouse, a mouse style or joystick style 
handheld device (iffhs receiver 320 siqiports a mouse pointer), a remote control touchscreen, 
or function or select buttons on a ronote control handheld unit 

The set top box or other types of receivers 320 operate preferably under 
1 5 software control to provide I/O and local resource control 324. Preferably, the receiver 320 is 
provided with die capability to access local media 322, indiich includes one or more of 
various commonly available media such as, for example, DVDs, CDs, CD-ROMs, flash 
memory, analog video and audio tapes, and digital video and audio tqies, as well as digital 
media ffles contained on stcvagp media such as an internal hard disk and accessed fiom 
20 various local c(»nputers over a local area network. Preferably, receiver 320 is provided with 
die capability to receive broadcast programming such as television broadcast 311 and 
additional infoimatimi through the broadcast 312. The additional information 312 is 
coordinated with the television broadcast 3 1 1 and preferably originates widi it, is oft« 
context sensitive by design, and iUustratively accompanies die television broadcast 311 in the 
25 vertiral blanking interval (for analog television). The television broadcast 311 and the 
additional information 312 is available is available by a variety of communications 
techniques, including radio, cable, satellite, and phone line. Preferably, receiver 320 is 
provided witti the capability to receive an electronic program guide ("EPG") 313, which may 
be provided in a separate broadcast channel, as a separate data stream in a digital television 
30 signal, or as additional information through the broadcast in the vertical blanking interval of 
an analog television signal, or is accessible fipom an Internet site. Preferably, receiver 320 is 
provided with the equability to access the Intanet, which includes a vast variety of resources 
as represented by servers 314 and 317. Intern^ access is available is available by a variety of 
connnunications techniques, including radio, cable, sateUite, and phone line. 
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The explicit/implicit filter 326 provides filtering for information bom various 
sources, so that preferably only context-sensitive information that is within the scope of the 
user's profile is furnished to the output device 332. The explicit/implicit filter 326 also 
prioritizes the filtered mfonnation, if desired, in accordance with the user's profile. The 

5 performance of the expUcit/impUcit filter 326 is dependent on the user*s personal profile, as 
defined by information contained in the adaptive user profile database 328, and on the user's 
selections as made by the user using selector 334. Moreover, the adaptive user profile 
database 328 itself is updated in accordance with the user's selections. 

The explicit/impUcit filter 326 acts on remote information sources 310 in 

1 0 various ways. For example, a user watching a television broadcast 311 may elect to use none 
of the additional information 312, all of the additional information 312, or only those aspects 
of additional information 312 that interests the user. In the later case, the explicit/implicit 
filter 326 acts on the additional information 312 by suppressing the use of information by the 
receiver 320 that is not within the scope of the user's personal profile and permitting the use 

15 of information by the receiver 320 that is within the scope of the user's personal profile. 

The explicit/impHcit filter 326 also processes information fi-om the electronic 
program guide 313 to enhance its usefuhiess to the user. Enhancements include notifying the 
user based on the user's profile when a program that the user is likely to enjoy is about to be 
broadcasted, eUminating entire channels and particular programs that the user is unUkely to 

20 want to watch, highlighting programs that the user may be particularly interested in watching, 
and so forth. 

The explicit/implicit filter 326 also act on requests (URL, CGI, and so forth) to 
and/or information received fi-om the servers 314 and 317 on the World Wide Web, as well 
as on requests to and/or information received from local resources and locally networked 

25 resources. Information from Web resident servers may be requested using an Intemet 
browser or may be pushed by the server to an Intemet browser, as is well known. The 
expUcit/implicit filter 326 operates on requests to and/or information received from Web 
resident servers in various ways, such as by: filtering the requests to limit them in accordance 
with the user's personal profile; augmenting the requests with additional requests in 

30 accordance with the user's personal profile, as when the explicit/implicit filter 326 
"recommends" information that is available from information sources on the Intemet; 
filtering the information received from sources on the Intemet to limit them in accordance 
with the user's personal profile; and prioritizing filtered information. 
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Through implicit filtering, the adaptive user profile database 328 captures the 
personality of a particular user (or several users, if more than one user uses the receiver 320), 
and is progressively refined and augmented to create an adaptive profile based on the user's 
history together with marketing statistics. The personal profile develops over time, in that the 

5 system "learns*' what type of information to offer to the user based on various criteria such as 
what the user usually selects and the amount of time that the selection holds the user's 
interest, if relevant, and adapts accordingly. For example, if advertising information rather 
than reference material is usually selected, the adaptive user profile database 328 reflects the 
user^s behavior in a ratio and uses the ratio in responding to the user's current programming 

10 choice or specific requests. 

Explicit filtering involves building or supplementing a user's profile based on 
her answers to specific questions. For example, detecting a new user, the explicit/implicit 
filter 326 presents a pre-programmed list of questions to the user to establish an initial 
profile, thereby allowing the filter 326 to function on at least a rudimentary level initially. 

15 Explicit filtering is also useful for confirming trends identified by the explicit/implicit filter 
326, thereby saving time in updating the user's profile, and for resolving any ambiguity that 
may be detected in a user's developed profile by posing questions to the user to resolve the 
ambiguity. Implicit filtering involves building a user's profile based on the users interactions 
with the receiver 320, including television program selections, additional information 

20 selections, selections fi*om the electronic program guide, Web links accessed, Web sites 
explored, purchases made, and so forth. The personal profile of each user using the meta- 
browser is stored in the adaptive user profile database 328, which preferably resides on the 
receiver 320 along with the explicit/implicit filter 326 and is locally accessible to the 
explicit/implicit filter 326. 

25 Implicit filtering may, if desired, draw fi-om collaborative data in building a 

user's profile. For example. Figure 4 shows that the explicit/implicit filter 326 has access to a 
profile mirror 315, which is associated with a collaborative filtering database 316 and the 
server 3 1 4. The profile mirror 315 may be another computer or another process ruiming on 
the same computer as the SCTver 314. It is not part of the collaborative filtering database 316, 

30 but rather includes profile information derived &om the collaborative filtering database 26 
and, if desired, fi-om the adaptive user profile database 328. The collaborative filtering 
database 316 is a sizeable database of profiles of users who visit the Web sites hosted by the 
server 314. A number of these users are likely to have profiles that are similar to the profile 
of the user whose profile is maintained in the adaptive user profile database 328. These 
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similar profiles are idratified by comparing the user's profile with the collaborative filtering 
database 316. Differences between the user's profile in the adaptive user profile database 328 
and the similar profiles in the collaborative filtering database 316 represent possible user 
interests, and as such are usefiil to the user in a variety of ways. 

5 One way in which the differences between the user's profile and the similar 

profiles in the collaborative filtering database 316 is usefiil is in response to a user's selection 
made with the selector 334 to receive personalized infomiation on a "push" bases. In this 
case, the server 314 illustratively has "push" capabilities. The differences are fiunished by the 
profile mirror 3 15 to the server 314 which thereby pushes only potentially meaningfiil 

10 information to the user. If the user acts on the pushed information, the adaptive user profile 
database 328 is updated accordingly. 

Another way in which the differences between the user's profile and the 
similar profiles in the collaborative filtering database 316 is useful is to create 
recommendations for the user under the assumption that the user might be interested in the 

1 5 same things as other users who have similar profiles. In this case, the differences are 

furnished by the profile mirror 315 to the receiver 320, which presents them as suggestions to 
the user. If the user acts on any of the suggestions, the adaptive user profile database 328 is 
updated accordingly. 

Another way in which the differences between the user's profile and the 

20 similar profiles in the collaborative filtering database 328 is useful is to augment the profile 
of the user whose profile is maintained in the adaptive user profile database 328, under the 
assumption that the user will be interested in the same things as other users who have similar 
profiles. The augmentation is performed in any convenient manner. For example, one 
technique involves copying the adaptive user profile database 328 to the profile mirror 315, 

25 updating the profile mirror with appropriate information fi-om the collaborative filtering 

database 316, and writing the updated user profile back to the adaptive user profile database 
328. Another technique involves copying the adaptive user profile database 328 to the profile 
mirror 315 so that the differences may be identified, then furnishing the differences to the 
explicit/implicit filter 326 which handles updatmg the adaptive user profile database 328. The 

30 new data in the user's profile is evaluated over time by the explicit/implicit filter 326 just as 
is other data in the user's profile. 

The collaborative filtering database 316 is also useful for establishing a 
"starter kit", or an initial profile of data for a new user. Preferably, the new user is asked a 
number of expHcit start up questions as part of the explicit filtering process by the 
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explicit/implicit filter 326, and then the adaptive user profile database is augmented from the 
collaborative filtmng database 316. 

Suitable algorithms and software for performing data collection and filtering 
and for maintaining databases such as the ad2q)tive user profile database 328 and the 
5 collaborative filtering database 3 16 is well known to persons of ordinary skill in the art. 
Generally known as software agents, suitable software is based on any of a variety of 
techniques, including Bayesian probability-based recommendation models, decision tree 
models, neural network models, and distance metrics. The database itself may be organized 
in any suitable way, including flat file, relational, and object oriented. Examples of a 
10 Bayesian probability-based recommendation model are described in, for example, the 
following articles, which hereby are incorporated herein in their entirety by reference: 
Pazzani, M., Muramatsu, J., and Billsus, D., Syskill & Webert: Identifying Interesting Web 
Sites, in Proceedings of the National Conference on Artificial Intelligence, Portland, Oregon, 
1996; Billsus, D. and Pazzani, M., Learning Probabihstic User Models, in Workshop Notes 
15 of Machine Learning for User Modeling, Sixth International Conference on User Modeling, 
Chia Laguna, Sardinia, 1997; and Pazzani, M. and Billsus, D., Learning and Revising User 
Profiles: The Identification of Interesting Web Sites, in Machine Learning 27, 1997, pp. 313- 
33 1 . An example of collaborative filtering is the technology being researched at the Media 
Laboratory of the Massachusetts Institute of Technology, Cambridge, MA and 
20 commercialized by such companies as Firefly Networks, Inc. of Cambridge, MA. 

Figure 5 is a flowchart shoAving an operating session of the meta-browser 
application software running on the receiver 320. Figure 5 is merely illustrative, since the 
meta-browser may be programmed in a variety of ways depending on the experiences, skill 
and preferences of the system architect and computer programmers. When the receiver 320 is 
25 switched to active mode (step 400), the meta-browser application determines in any suitable 
way, as by user ID and password whether the current user is a new user (step 410). If the 
cunent user is a new user, a user profile is estabUshed (step 414) in any suitable manner, as 
by explicit filtering with or without supplementation by collaborative filtering. If the current 
user is an former user, his or her profile is loaded. 
30 A unified browsing space then is displayed based on the user profile (step 

416), the unified space being, with reference to the previously described library metaphor, the 
graphical display of an entire library, selected floors of the library, or a particular floor. The 
unified browsing space is populated with information arranged in a number of different 
media collections. The information is acquired in any suitable way. One example is for the 



wo 01/24047 PCT/EPOO/09407 



meta-browser application to remain active even while the receiver is on standby, gath^g 
and updating information in accoidance with the user's profile. In this way, whenever the user 
begins to use the meta-browser, the library already contains updated information in the fomi 
of content, links and recommendations. 

5 The meta-browser preferably monitors for "data events" even if the user 

engages in other activities such as watching television or listening to music, and provides the 
user the ability to browse the unified space through navigation events and to take actions 
through user events (step 418). A data event includes the receipt by the receiver 320 of 
information or programming that is relevant to detemaining the interests of the user. An 

1 0 example of a data event is a new television program running for a significant time fi*om its 
beginning, even if no channel was changed to receive the new program. Another example of 
a data event is the playing of a new musical selection fiom a Web "push" site such as 
spinner.com, for example. When a data event is detected (step 420), the user profile is 
updated accordingly (step 422). 

15 A navigation event occurs when the user selects an arrow to move between 

floors, to move to a particular stack on a floor, and to move along a stack. When a navigation 
event is detected (step 430), the navigation command is processed (step 432) so that the user 
moves as directed in the virtual library. 

A user event includes any action taken by the user with the selector 334. 

20 Examples of user events are a request for recommendations, request for an expanded 

recommendation based on collaborative filtering, selection of a screen object to obtain more 
information about the object or to perform a fimction indicated by the object, selection of a 
listed option to perform a particular fimction, and a context-based search. 

If the user makes a request for recommendations (step 450), the meta-browser 

25 makes recommendations based on the context in which the request is made and the current 
user profile (step 452). With respect to Figure 2, for example, a user watching a Westem on 
television receives recommendations about, for example, other television Westerns from 
stack 135, TV magazine features on Westerns from stack 132, news reports on events related 
to Westerns from stack 133, movie soundtracks of Westem fihns from stack 124, country 

30 westem music from stack 125, and Westem movies from stack 1 15. A similar result is 

realized if the user is browsing a shelf of Westem television shows in stack 135 and presses 
the recommendation button. 

If the user makes a request for an expanded recommendation based on 
collaborative filtering (step 460), the meta-browser makes recommendations based on the 
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context in which the request is made, the cmrent user profile, and through collaborative 
filtering the profiles of others having interests generally similar to the interests of the user 
(step 462). 

If the user selects a screen object to obtain more information about the object 
5 or to perform a function indicated by the object or selects a listed option to perform a 

particular function (step 470), the user*s profile is updated to reflect the selection (step 472) 

and the selection is processed (474). 

The user may elect to perform a search directly fi-om the screen depiction of 

the unified space (step 480), or from a screen object or an options list (step 470). A search 
1 0 directly bom the screen depiction of the unified space is based on the context display on the 

screen and the keyword or other search term or example used. Such a search may be 

otherwise unconstrained by the user's profile (stq>s 482, 483 and 484), or the search results 

may be filtered and prioritized in accordance with the user's profile (steps 482, 485, 486 and 

487), as desired by the user. 
15 The various methods and apparatus described herein enhances a user's 

browsing experience by providing easy access to relevant information, an in particular to a 

variety of different media content from a variety of different sources in a personalized, easy 

and intuitive way. 

The description and applications as set forth herein are illustrative and are not 
20 intended to limit the scope of the invention, which is defined in the following claims. 

Variations and modifications of the embodiments disclosed herein are possible, and practical 
alternatives to and equivalents of the various elements of the embodiments are known to 
those of ordinary skill in the art. These and other variations and modifications of the 
embodiments disclosed herein may be made without departing from the scope and spirit of 
25 the invention, as set forth in the following claims. 
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CLAIMS: 



1 . A method of realizing personalized information for a iiser from multiple 

information sources^ comprising: 

establishing (410, 412, 414) a user profile for the user based on various 
interests of the user; 
5 establishing (41 6) a virtual imified space; 

populating (416) the virtual unified space with a plurality of different virtual 
media collections in accordance with the user profile; and 

browsing (418) the unified space under user control. 

10 2. A method as in claini 1 wherein the virtual imified space is a virtual library 

(110,120, 130). 

3. A method as in claim 1 wherein the virtual unified space comprises a floor of a 
virtual library (1 10, 120, 130). 

15 

4. A method as in claim 1 wherein the user profile establishing step comprises 
loading (412) fi-om memory a previously created user profile. 

5. A method as in claim 1 wherein the user profile establishing step comprises: 
20 presenting a variety of questions to the user about the user*s interests, and 

creating a user profile based on the user's answers to the questions. 



6. A method as in claim 1 wherein the populating step comprises: 

acquiring information items firom a plurality of information sources of 
25 different media type (3 1 0, 322) in accordance with the user profile (328); and 

placing the infomiation items into the virtual multiple media collections based 
on their respective information sources. 



7. 



A method as in claim 1 wherein the populating step comprises: 
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comparing the user profile (328) with a collective profile database (316) to 
establish a similar collective profile; 

acquiring infomiation items fiom a plurality of information sources of 
different media type (310, 322) in accordance with the collective profile; and 
5 placing the information items into the virtual multiple media collections based 

on their respective infomiation sources. 



8. A method as in claim 7 further comprising: 

identifying (470) a selection of at least one of the information items by the 
10 user firom one of the media collections; and 

updating (472) the user profile in accordance with the identifying step. 

9. A method as in claim 1 wherein the media collections comprises respective 
pluralities of similarly classifiable information items, further comprising: 

15 identifying (470) a selection of at least one of the information items by the 

user fi'om one of the media collections; and 

updating (472) the user profile in accordance with the identifying step. 

10. A method as in claim 1 further comprising augmenting (492) the user profile 
20 in accordance with a collaborative data base. 



11. A method as in claim 1 further comprising: 

searching (483, 485) the virtual unified space with a search engine under user 

control; and 

25 updating the user profile in accordance with the searching step. 



12. A method as in claim 1 1 further comprising storing results of the searching 

step as media collections in the unified space for browsing by the user (484, 487). 

30 13. A method as in claim 1 2 further comprising fihering (486) results of the 

searching step in accordance with the user profile. 

14. A method as in claim 13 further comprising prioritizing (486) results of the 

searching step in accordance with the user profile. 
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15. A receiver apparatus for obtaining content ftom multiple information sources 
for viewing by a viewer, comprising: 

an input/output C W) controller (324) including an Intemet connection input, 
5 a video output, and a selector input; 

an adaptive user profile database (328); 

a filter (326) coupled to the adaptive user profile database, the filter being 
coupled to the I/O controller for filtering information fi^om the Intemet coimection input in 
accordance with the adaptive user profile database; 
10 means (416) for displaying a virtual unified space through the video output; 

means (416) for populating the virtual unified space with virtual multiple 
media collections using the filtered information firom the implicit filter; and 

means (41 8) for browsing the unified space in accordance with the selector 

input. 

15 

16. A receiver apparatus as in claim 15 wherein the media collections comprises 
respective pluralities of similarly classifiable information items, further comprising: 

means (334) for identifying a selection of one of the information items by the 
user from one of the media collections; and 
20 means (326) for updating the adaptive user profile database in accordance with 

the identifying step. 

17. A receiver apparatus as in claim 16 further comprising means (315, 326) for 
augmenting the adaptive user profile database in accordance with a collaborative data base. 

25 

18. A receiver apparatus as in claim 17 wherein the I/O controller further 
comprises an input for receiving television programs (3 1 1), including additional information 
(312) through the television program and electronic program guide information (313), the 
filter being coupled to the I/O controller for filtering information from the telcAdsion program 

30 input in accordance with the adaptive user profile database. 

19. A computer program product comprising a computer readable medium having 
program logic recorded thereon for enabling a computer-enabled apparatus to display 
personalized information for a user from multiple information sources, comprising: 
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means (410, 412, 414) for establishing a user profile for the user based on 
various interests of the user; 

means (416) for establishing a virtual unified space; 
means (416) for populating the virtual unified space with a plurality of 
5 different virtual media collections in accordance with the user profile; and 

means (418) for browsing the unified space under user control. 

20. A computer program product as in claim 19 wherein the media collections 
comprises respective pluralities of similarly classifiable information items, fiirther 

10 comprising: 

means (470) for identifying a selection of one of the information items by the 
user fi'om one of the media collections; and 

means (472) for updating the user profile in accordance with the identifying 

step. 

15 

21 . A computer program product as in claim 20 further comprising means (492) 
for augmenting the user profile with reference to a collaborative data base. 
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